OPTIMAL CONSUMPTION PROBLEM IN A 
DIFFUSION SHORT-RATE MODEL 



Daniel SynowiecQ 

Abstract. We consider a problem of an optimal consumption 
strategy on the infinite time horizon when the short-rate is a dif- 
fusion process. General existence and uniqueness theorem is il- 
lustrated by the Vasicek and so-called invariant interval models. 
We show also that when the short-rate dynamics is given by a 
Brownian motion or a geometric Brownian motion, then the value 
function is infinite. 
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1. Introduction 

Let rt be the short-rate (i.e. the rate offered by a bank) at time 
t > 0. Assume that (r^) satisfies the following stochastic differential 
equation 

drt = fi{rt)dt + (T{rt)dWt, 
To = r, 

where (Wt) is a one- dimensional Brownian motion defined on a filtered 
probability space {^,J^, (J?-t),P). 

Let us denote by v}'^'^''"^ the capital at time t of a bank account 
owner whose consumption rate is C and whose wealth at time is 
f > 0. Then 

dVl''-'^^''^ = [nVf-'^^''^ - dt, l^f = V. 

Let 

(2) rf ^^'"^ = inf |t > : y/^^'^'''^ = 

be the bankruptcy time. 

In the paper it is assumed that any consumption rate C is progres- 
sively measurable and non-negative. The space of all consumption rates 
is denoted by U. 
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Given a discount factor 7 > and an exponent a G (0, 1) of the 
power utility function, we are concerned with the following problems: 

Problem A Given r and f , find a consumption rate C'('"'^) g U which 
maximizes the performance functional, that is, 

J(C'(^''');r,^^) = sup J((:7;r,t;), 

C&J 

where 

(3) J(C; r,v):=K [ ^ e-^'C^dt, 

Jo 

ta = T^'^'^\ and is the conditional expectation E(- |ro = r). A 
solution to this problem is given in Proposition [T] and Theorem [2] below. 

Problem B It is reasonable to assume that one keeps his money in 
the bank account as long as the interest rate is positive. Under this 
assumption the performance functional is given by 

fTB 



JBiC;r,v) :=E^ 



e-^*Cfrft + e-^--V;i-X{r,<oo} 



where tb = rf''"'"'"'^ A , = inf {t > : n = 0} and V = V^^''''''\ 
Clearly, if r < 0, then tb = 0. The goal is now to find a consumption 
rate which maximizes Jb (see Proposition [2] and Theorem H]). 

Problem C Let p{t, 9) be the price at time t of a zero-coupon bond 
that pays off 1 at time 9. If one may also invest in zero-coupon bonds 
then the wealth dynamics is formally given by 



(4) + (1 - r/,)^/--^ r ^-^i^it, 

Jo P{t, 9) 

Vo = V. 

where u = [C, rjjtp), ip is the density of the distribution of investments 
in bonds with various terminal time 9. The aim is to maximize the 
performance functional J given by ([3]) with ta = t^''^''"'' . 

Problems A, B and C defined above are particular cases of an investor 
problem, various types of which has been investigating since 1970's (see 
[7] and [8]). However, most of them are concerned with investment in a 
bank account (usually on a constant rate) and a finite number of stocks. 
If one can invest in a bank account and zero-coupon bonds, then the 
investor problem is more difficult to solve. The reason is that there 
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can be an infinite number of bonds, since tlie time of maturity 6 can 
take an infinity of values. Furtliermore, tlie set of admissible strategies 
does not contain "buy and liold" strategy, i.e. one must convert bond 
to casli at maturity. 

Tlie type of an investor who can invest his money in bonds has been 
recently studied in [1], [6] and [11]. Contrary to our paper, authors of 
[1], [6] and [11] examined the portfolio problem without possibility of 
consumption and with a finite time horizon. On the other hand, in [T] 
and pLlJ it is assumed that the dynamics of the instantaneous forward 
rate is given and that the performance function is defined under a real 
measure. More references can be find in the survey paper [T^ . 

In the paper we use the Hamilton-Jacobi-Bellman approach, whereas 
in [1] and [11] convex duality is used. 

2. Preliminaries 

In the paper, it is assumed that ([T]) defines a Markov family on an 
open subinterval OCR, which, in particular, means that O is invariant 
for (pP); that is, Tq G (9 implies that rt G for all t > 0. Moreover, 
it is assumed that a G C^(0), fi G C^(C), their first derivatives are 
bounded on O, and that the diffusion is non-degenerate, i.e. a{r) ^ 
for all r G C 

The value junction for one of the listed above problems is the maxi- 
mum of the corresponding performance functional over the set of admis- 
sible controls. We will show that the value functions are very regular, 
namely in r. Let 

(5) Qf[r):=\y\r)r\r)^^{r)r[r), 

be the formal generator of the diffusion given by ([1]). 

The results below have the form of the verification theorem for sto- 
chastic control problems. For similar results see e.g. [2], [9] or [10] . 

Proposition 1. Let K G C'^{0) he such that 

(6) QK{r) + (ar - -i)K{r) + (1 - a)K^^ (r) = 0, 

for every r & O. Then $(r, f) = K{r)v°' is the value function for 
Problem A, whenever for any C & U and r & O, 

(7) limE'-e-^^"$(r.„,Kj = 0, 

n.^oo 

where (r^) is given by 1^, Tn = n A t^''^''"^ and V = \/('^''^''") . The 
optimal consumption is given in the feedback form 
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Proof Taking into account the dynamics of (Vt) and the form of per- 
formance functional we see that 

for a certain function K. The Hamilton-Jacobi-Bellman equation (see 
e.g. 0, M) for K is 

sup {-7fs:(r)t;° + QK{r)v'' + a{rv - C)v''-^K{r) + C"} = 0. 
c>o 

The supremum is attained at C given by ([8]). Hence, i^' satisfies ([6]) 
and the HJB verification theorem (see [9], [10]) gives us the claim. □ 

In Problem B we have to assume that G (9. If not, Problem B 
can be reduced to Problem A. Let C+ = C n [0, oo) and C++ = O n 
(0, oo). With a similar proof as above we have the following proposition 
concerning Problem B. 

Proposition 2. Let K e C2(0++) n C(C+) satisfy (Q. Then 

. . _ / r G 0\0++, 

^l'^,^; - I ^ e 0++, 

t/ie i'a/'ue function for Problem B, whenever for any C & U and 
r G C++, 

(9) hm E^e-^-"$(r.„, KJ = E^^e'^^- V;>{.,<oo}, 

n^oo 

where tb = t^^'^'^"*, Tt^'^'^^ = n A tb and V = V^'"'^''"K The optimal 
consumption is given in the feedback form . 



Note that K satisfies a non-linear, non-Lipschitz second order dif- 
ferential equation, but K is not defined as a solution to the Cauchy 
problem. The goal of the paper is to prove the existence of the solution 
satisfying appropriate boundary conditions and to find an approximat- 
ing scheme for K. 

3. Solution to Problem C 
In Problem C we assume that P is a martingale measure. Then 

pit,9)=E(e-f''^'''\J^t). 

Since (rj is a Markov process, pit, 6) = u^{t,rt) is a function of t, 6* 
and rj. Thus we can rewrite dl]) as follows 

(10) dVt = (rtVt - Ct)dt + (1 - Vt)VMrt) / 9\ ) ' e)dedWt 

Jo ^ [tj ^t) 
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with V = V^'^'^''"\ whenever is different iable with respect to r. 

In Problem C the performance function is given by ([3]), the class of 
admissible controls U consists of tuples (C, t], ip{-, 6)q>q) of progressively 
measurable processes, such that Ct is non-negative, (fTUl) is well defined 
and 

/"OO 

i){t, e)de = 1, ^p{t, 9) = 0, < t. 

Note that neither rj nor ip have to be non-negative. 
Define 

(11) T,= / l' ^{s,9)de and = (1 - r7,)T,. 



Then we can rewrite ( ITOl) in the form 

(12) dVt = {nVt - Ct)dt + (3tVta{n)dWt. 

Since we assumed that we are given dynamics of (r^), and the per- 
formance functional is under a martingale measure, we can treat the 
investor portfolio as the one consisted of the bank account and one 
other instrument with price St given by 

(13) dSt = St indt + airt)TtdWt) , So = 1. 

Note that given (fT2|) and (fT3l) . we have to assume that for any t > 0, 

/ T^ds < oo, / P'^ds < oo, P - a.s. 
Jo Jo 

Therefore the dynamics of the wealth of the investor is given by 

dVt = {wtVt - Ct)dt + (1 - r]t)VtdSt/St, 

which is equivalent to (jl]) and f[T^ . Thus the number of instruments 
is finite and the same approach as in [S] can be taken. 

Theorem [1] below, giving a solution to Problem C, was formulated 
and proven in [5] under much weaken conditions. Here we present 
another proof, based on Proposition [3] below. We restrict our attention 
to the value function of the problem. We refer the reader to [5] for 
details on the optimal control (portfolio). 

Proposition 3. If K e C'^{0) satisfies 

(14) gir(r) + (ar-7)i^(r) + (l-a)ir^(r) + -^f!M^^^^ = 0, 

2(1 — a) K[r) 

then $(r, v) = K{r)v"' is the value function for Problem C, whenever 
for any u ElA and r E O, 

(15) lim E'-e-^""$(r,„,Kj = 0, 
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where Tn = n A t^'^'""^ and V = V^'^'^''"\ The optimal consumption C 
and the optimal factor (3 defined in ( ITTj) are given by 



K' 



(16) C = K^^v, P = 

[I — a)K 

Proof Again $(r, t;) = K{r)v°' for a certain function K. The HJB 
equation for K is 

QK{r)v'^ + {ar - -f)K{r)v'^ + sup {C" - CaK{r)v''~^} 



(17) 



c>o 

a(a — 1"! 



+ sup ^a(3a\r)K'{r)v'' + ^'^^ ^' /?V(r)i\:(r)t;"| = 0, 

and the claim folfows from the HJB verification theorem. □ 

Since the value function $(r, v) is a non- decreasing positive function 
of both arguments r and v > 0, we see that K is non-decreasing and 
positive. Then the optimal (3 in ( fT6l) is positive. Note that r] < 1 and 

> whilst the short-selling is forbidden. Then the condition 

(18) ^u%t,r,)<0, 

which holds e.g. in Vasicek and CIR models, implies that if the short- 
selling is forbidden then necessarily and jSt given by flTT]) are non- 
positive. Thus the supremum over /3 < in equation ( |T71) is attained at 
0. Hence, if the short-selling is forbidden and ( |T8i) holds, then Problem 
C reduces to Problem A. 

It is worth mentioning that given (3 we do not have unambiguous 
solution to Problem C, i.e. we do not obtain unambiguous pair {ri,ip). 
However we may choose arbitrary ip such that (C, r),ijj) G W and then 
we derive an optimal fj from (ITT!) . For example we may set ip{t,6) = 
(^g-?{f-t) . for some <j > 0. 

The following result will be used to show the regularity of the value 
function. Let 

/■oo 

(19) N{r):=K' eT^(-^*+"^o '•»'^«)rft, r E O. 

Jo 

Proposition 4. If N{r) < oo for every r E O and 

poo ^ 

(20) EM eT^(-^*+"^o'^«'^^)rft < oo, WreO, 

Jo 

then N e C^{0) and 

ar — ^ 

(21) QN(r) + -N{r) + 1 = 0, reO. 

1 — a 
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Proof Let O = (a, b), where a > — oo and b < oo. Then, by ( l20l) . 

Jo 

is a solution to the boundary problem 

QNn{r) + ^iV„(r) = -1, 
iV,(a,) = Nn{bn) = 0, 

where 

a + 1/n, a > — oo, ^ _ f ^ ~ l/''^^ b < oo, 
—n, a = —oo, " ra, b = oo, 

and = inf{t > 0: ^ [a„,,6„]}. Since we assumed that O is 
invariant for ([T]), then lim^^oo = cxd for any r G (9 and consequently 
A^(r) = limn^oo Nn{r) . Thus is a weak solution (see Definition [T] in 
Section [5]) to fl2T]) . and by Lemma [H iV G C^((9). Hence, it is a strong 
solution to fl2T|) . □ 

The result below says that the function K appearing in the identity 
$(r, v) = K{r)v°' for the value function equals A^^~". 

Theorem 1. Let assumptions of Proposition^hold. Assume addition- 
ally that for any u ElA and r E O, 

(22) lim We-^^-N^~"{r^^)V^ = 0, 

where = n A t^''^''"^ and V = V^";^'""). Then $(r, = N'^~''^{r)v°' is 
the value function for Problem C. 

Proof By elementary calculus, fl2T|) is equivalent to f|T4l) for K{r) = 
N^~°'{r). Condition fl22l) implies f|T5l) and we conclude by Proposition 

s □ 

4. Solution to Problem A 

This section contains one of the main result of the paper. It provides 
the existence and approximating scheme for the solution K to the HJB 
equation for Problem A. In its formulation {E, \\ ■ \\e) is a Banach 
space of continuous functions on O. 

We will need the following hypotheses: 

(H.l) For any fixed t>0, rEO,ipEE and any sequence {T„} of 
stopping times, the sequences of random variables 

<^(nATje"^o"""'-»'^4 and ( r^\{r ^'^ "--^^ ds 



are uniformly integrable with respect to P*" = P (■ |ro = r). 
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(H.2) For any Lipschitz continuous bounded function /: [0, oo) i— >• 

[0, oo) and for any non- negative (p & E, one has /(0) G E. 

(H.3) The family {Pt,t > 0) of hnear operators 

(23) Pty^{r) = EXri)e"^o reO, 
forms a Co-semigroup on E. 

Remark 1. In examples O = W and 

E = {ipeC{R): lim \ip{r)\e''^\''\ = 0} 

|r|— >oo 

or (9 is a bounded interval and E is the space UC{0) of uniformly 
continuous functions on O. Moreover, we will show in Lemma [2] that 
the generator {A.Vi^A)) of {Pt) is given by 

V{A) = We C\0) HE: A^e E}, 

and Aif = Aif for all G ^{A)^ where A is the differential operator 

(24) ALp{r) = Qip{r) + arLp{r). 

We note that condition (H.l) will be needed only in the proof of the 
inclusion e C^iO) n E : A^ e E} C. V{A). 

Recall that iV is a function defined by (fT9|) . The following hypoth- 
esis will be needed in the proof that N^'"" is a supersolution to the 
HJB equation ([6]), such that A^^"" G V{A) and $7v(r,w) = iVi-"(r)t;" 
satisfies the boundary condition ([7j). For more details see Definition [2] 
and Remark O 
(H.4) For any r G C, 

(25) lim E'^e-^*+° rsds^i-a (^^) = q 

and for any stopping time t^^'^''"\ 

(26) {e-^-+"^o^"^^^'^^iVi-"(r.Jx^^(c;..)^^J 

is uniformly integrable, where Tn = n /\ t^''^'^'' . 

Moreover, A^^"" G (7^(0) n E and AiV^"" G E, where A is defined 

by m- 

For any m > 0, define 

(27) F.(^) = ( ^ V^""^' n<"r'"-i 

m — amx, U < x < m . 

Recall that A is the generator of the semigroup (Pt)- We denote by 
Q{A — 'y) the resolvent set of .4 — 7. The proof of the following theorem 
is postponed to Section [71 



raSN 
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Theorem 2. Assume that (H.l), (H.2), (H.3) and (H.4) are ful- 
filled. Then there is a solution K to with condition . Moreover, 
K{r) < A^"'^~"(r), r G C Finally, for any sequence {\m} C g{A — 7) 
such that for any m > 0, 

(28) the mapping [0, 00) 3 x Fm{x) + XmX is non-decreasing , 
one has 

K{r) = lim lim i^™(r), r e O, 

m— ►oo n^oo 

where {K^^} is a non- decreasing sequence of both m and n, defined as 
follows 

= 0, 

i^r+i = (A„. + 7 - A)-\F^{K^) + A^i^r)- 

Remark 2. Since Fm are Lipschitz continuous, then the function x t— > 
Fm{x) + Aa; is non-decreasing for A large enough. Thus there is a 
sequence {Am} C q{A — 7) such that the functions x t— > Fm{x) + XmX 
are non- decreasing. Furthermore, from Co-semigroup property of (Pt) 
guaranteed by (H.3) we get 

\\PM\e < Me'^'yWE 

for some and M > 0. Then (t?, 00) C q{A) and setting any £1 > 
and £2 > we may define 

(29) Am = maxj?? — 7 + £1, am + £2}- 

Remark 3. We will show in Sections 191 and fTOl that the assumptions 
of the Theorem [2] are satisfied if (r^) is an Ornstein-Uhlenbeck process 
(the so-called Vasicek model) or O is bounded. We will show in Section 
[TT] that if {rt) is either a Brownian motion or a geometric Brownian 
motion then the value function for Problem A is infinite. 

5. Analytical tools 

This section provides some useful analytical tools. Let us consider a 
second order differential operator 

Du{x) = a2{x)u"{x) + ai{x)u{x) + ao{x)u{x) 

with tti G C*(C) and 02 7^ in O. We denote by 

D*u{x) = {a2{x)u{x))" — {ai{x)u{x)y + ao{x)u{x) 

the formally adjoint operator. We denote by Lj^^^O) the space of all 
locally integrable functions on O. 
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Definition 1. Let f,uE Lj^^^O). We call u a weak solution to the 
equation Du = / if 



u{x)D*ip{x)dx = / f{x)ip{x)dx, Vy? G Co°°(0). 
o Jo 

Let Q be an open subset of M. The following result holds only in 
dimension 1. For a counterexample in case of (9 C see |3]. 

Lemma 1. Assume that H : Q is a continuous function and u G 
L]^JJD) such that u{0) <^Q , is a weak solution to 

(30) Du = H{u). 

Then u G C'^{0), i.e. u is a strong solution to fl30|) . 
Proof We may rewrite fl30l) in the form 

(31) {a2u' + (ai — a'2)u)' = H{u) — {a'2 — a[ + ao)u, 

where we skip argument x and all derivatives of u are in the weak sense. 
We can use the following fact. Assume that ^ is a distribution whose 
derivative is a function h G Ll^^{0). Then ^ is a function and 

e(x) = C + / h{y)dy, 



A 



for some finite A G O and C G M. Applying this observation to (13T!) 
we obtain 

a2u' + (ai — a'2)u = Ci + / {H{u) — (03 — a'l + ao)u)dy^ 

J A 

where the r.h.s. is continuous, since integrand is locally integrable. 
Thus 

, Ci !a^H{u) - (4' - a'l + ao)u)dy Ui - a!^u 

u = 1 

02 a2 02 

and u' G Lj^^^O). Using the same argument again we have 

, r I Ci Ki^iu) - {a'i-a[ + ao)u)dy (^^ _ 

u{r) = C2+ / \ dx 

J A y«2 a2 a2 j 

and u E C, since integrand is locally integrable. Having shown that 
u G C{0), we see that the integrand is continuous, which implies u G 
C^{0). Now we conclude that integrand is of class and consequently 
u G C^{0). □ 

Recall that A is a differential operator given by (!24|) . We denote by 
(AyV^A)) the generator of the Co-semigroup (P^) defined by (123!) on 
the Banach space E, see (H.3). 
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Lemma 2. We have 

V{A) = G C\0) HE: A^e E}, 

and Aip = Aip for all ip G V^A). 

Proof Write £ = e C\0) HE: AipeE}. 

Step 1. Here we will show that 'DlA) C S. Let ip G V{A). First we 
will show that {Ap,ip) = {p,A*ilj) for any ip G C^{0). We have 

{Aip,ip) = Urn- / {Ptp{x) — p{x))ip{x)dx 
*J-0 t Jo 

= ^^f?7 / / Pt{x,y)p{y)i'{x)dxdy -Yim.^ [ p{y)ij{y)dy, 

where pt{x,y) is a transition density function of process (r^), which 
exists due to the non-degeneration of the diffusion coefficient. Hence 

{Ap,'^)=\im^ ( pt{x,y)ilj{x)dx -■^{y)] (p{y)dy 

tlO t Jq \Jq J 

= lim / p{y)\ \ / ^{x){pt{x,y)dx - by{dx))\dy 



m Jo \t 



o 



^{y)[ I ^{x)^Pt{x,y) dx]dy 



O \JO 



t=0 J 



and since the transition density function satisfies backward parabolic 
equation, it follows that 



{A<p,ij) = j p{y) (^j ^{x)A^pt{x,y) ^_^dx^ 



dx ] dy, 



where subscript x denotes that the operator A acts on pt{x,y) as a 
function of x with t and y fixed. Thus we have 

{Ap,ij) = j p{y) (^j ij{x)AJy{dx)^ dy 



(p{y){AJy,^lj)dy = / p{y){6y, Ali/j)dy 
o Jo 

ip{y)A;ijiy)dy= {p,A*^). 



o 

Thus (/? is a weak solution to Aip = Ap. By Lemma [1], p G C'^{0) and 
p is a. strong solution to Ap = Ap. Hence Ap = Ap and Ap G E. 

Step 2. We will show that £ C V{A). Let p E £. Then from Ito's 
formula 

^in^rje'^lo = / e''Ior^'^-Apir,)ds + M,^T., 
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where T„ = inf{t > 0: \rt\ > n} and 

Jo 

is a martingale. Taking expectations and next passing to limit with n, 
thanks condition (H.l), we obtain 

rt 

EXn)e"^o'^»«'^ = <^(r) + / E'^e"^o""'^M(/?(r,)rfs, 

Jo 

which means that Pt<^{r) = Lp{r) + PsA(f(r)ds. Therefore by the 
mean-value theorem 

lim - '^(^) = 1 r p^Aip(r)ds = Aip(r), 

m t m t Jo 

which means that ip G T>{A) and Aif = A(p. □ 

6. LiPSCHITZ MODIFICATION OF THE HJB EQUATION 

In this section we will find a twice continuously differentiable solution 
to the equation 

(32) QK{r) + («r - -f)K{r) + Frr,{K{r)) =0, reO, 
where is given by ([27]). 

Remark 4. It is easy to verify that Fm is a continuous Lipschitz func- 
tion with Lipschitz constant Lm = cyrn. Moreover, e Ci((0,oo)). 
Equation (!32l) may be interpreted as HJB equation for Problems A and 
B with assumption that Ct = CtVt and Cf G [0,m]. Hence, a solution to 
([BD should be a limit of the sequence of solutions to (15^ as m — oo. 

Define := (A - 7) and Aj := (^ - 7). Note that ([32D can be 
written as 

(33) - A^K = Fm{K) in O. 
Definition 2. We call u G C^{0) a suhsolution to ([33]) if 

-A^u < F^iu) in O. 
We call M a supersolution if 

— y4^u > Fm{u) in (9. 

Remark 5. It is easy to verify that ^ = is a subsolution to fl33]) . 
Note that K{r) = A^(r)^~" is a supersolution, since, by Proposition HJ 

_ _ aa2(r)(Z'(r))2 _ _ 

2 1 — a)K[r) 
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Furthermore, by (H.4), iY^"" e V{A) and $7v(r,t;) = N^~''{r)v°' 
satisfies ([7]). 

Theorem 3. Let KJ" G T>{A) and G T>{A) be a subsolution and 
a supersolution to (133|) , respectively. Assume that < K . Define 
= K"" and JsT^+i as 

(34) ir™ 1 = i^m - A,)-\FUK) + XmK), 

where Am is such that ( l28i) holds. Then K"^ defined as a pointwise limit 
of{K:^}, I.e. 

(35) ir™(r) = hm iT^l^)- Vr G O, 

belongs to C^{0) and is a strong solution to (!33l) . Moreover, < 

Proof From 

we get (Am - ^^)(K™ - K™) > 0. Since Ptif > and consequently 
(Am - A^)-^(f > for every > 0. It follows that K"" < K^. 

Now we show that K^^ is a subsolution. From fl25]) and flM|) we have 

Fm(i^r) + A,ni^r > i^n^(^'") + Am^'" = -A^K^ + X„.K^ , 

which, with help of Lemma O implies that K]^ is a subsolution to (!33ll . 
Hence, by induction, KJ^ < -ft'^i and K^^^ is a subsolution for all 
n G No. _ 

Now we show, by induction, that < K for all n. By definition 
<Ti^. Assume that K^^^ kTT^ . Then from ([34]) and (EH]) we have 

-^^ir;r+l + Ami^r+l = + Ami^r < i^,n(:^") + Am^^". 

Hence, 

-^^i^r+i + Ami^r+i < F^{K^) + Am^ < -A^" + A™^" 

implies that (Am - ^^)(Z™ - fsT^+i) > 0, and we obtain K^;^^^ < K^. 
Summing up, we have 

^"^ < i^i" < < • • • < < • • • < in 0. 

Therefore K™'{r) given by fl35]) exists for all r. Since Fm is continuous, 
Fm(K™(r)) = hm Fm(K™(r)), Vr G O, 

n— >oo 

and from (134)) we have 

/ y.(r)(Am-A)^r+iWrf^= / (Fm(Krw) + Ami^rw)v^Wrf^, 
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for any test functfon G C^{0). By Lemma Ej 

o Jo 
Let n ^ oo. By the dominated convergence theorem, we get 



(36) - / K'^{r)A*^^{r)dr = / F„(ir'"(r))(^(r)dr. 

Jo Jo 

Since K™' < TC^ and is continuous, then K"^ is focally bounded. 
Hence, K"^ is a weak solution to (!33|) . and we conclude by Lemma [H 

□ 

7. Proof of Theorem [2] 

Let {K"^} be the sequence constructed in the previous section. By 
(125]) and (EH]) the function $7v(r,t;) = A^^-"(r)t;" satisfies (E]). So 
does $o(^)'^) = 0. Hence, Remark [5] and Theorem [3] guarantee that 
^m{r,v) = K"^{r)v'^ satisfies ([7]). Therefore, by Remark HJ $m(r, w) is 
the value function for Problem A with constraint Ct < mVt. Hence, 
{K"^} is a non- decreasing sequence and the function 

K{r) = lim if'"(r), r G O, 

m^oo 

is well defined. Note that K > in O. Indeed, from the continuity of 
rt we have e-^o'""'^'^ > 0, P-a.s. for all t > and r G (9, which implies 
E''e-^o ^"'^^ > 0, and therefore 

/"OO 

Kl{r) = (Ai - A^yh = / e-(^^+^)*E"e"^o '■^'^^rft 

Jo 

is strictly positive in O. Since Kl < < K"^ < . . . < K"' < . . . < K , 
we have i^' > 0. Thus, in particular, F{K) is well defined, where 
F{y) = (1 — a)y'^ , for every y > 0. 

We will show that ii' is a weak solution to 

(37) - A^K = F{K) in O. 
To do this define 

Z.^ = {reO: K'^ir) > m""^}. 

Clearly Zm C Zm+i for all m G N. Since Fmiy) = F{y) for every 
y > m°~^, we have 

F^(ir™(r)) = F(ir™(r)), Vr G Z„ Vm > n, 

which implies, from continuity of F, that for any r G U^i ^n, 

(38) lim F„(ir'"(r)) = lim F{K"\r)) = F{K{r)). 
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Now we show that ( l38l) holds for any r G O. To do this note that 
U^i -^n = C*. Indeed, since K^{r) > for any r E O, then for any 
r G O there is such m, that 

K"(r) > K\r) > m"-^ > 0, 

and hence r G Zm- 

Note that for any m > 1 and r G O we have 

\FUK^ir)Mr)\ < (1 - a)iK\r))^^\^{r)\. 

Let m — > oo in ( l36l) . By the inequahty above and the dominated 
convergence theorem, we get 

- / K{r)A;ip{r)dr = [ F{K{r))ip{r)dr, Wipe 0^(0), 
Jo Jo 

which means that i^' is a weak solution to fl57|) . whenever K is locally 
integrable. Since K = A^^^" g E, we have K < N^~°' and from 
continuity of A^^~", the function K is locally bounded. By Lemma [H 
i^' is a strong solution to (jSTj). 

By ( !25|l and (!26|) . $(r, t>) = K{r)v°' satisfies the boundary condition 
©• 

8. Solution to Problem B 

This section provides the existence and approximating scheme for 
the solution K to the HJB equation ([6]) for Problem B. Let {E, || ■ H^.) 
be a Banach space of continuous functions on . 

Recall that Tq = inf{t > 0: = 0}. For all r G we define the 
following functions: 

N{r) = /" " e^(-^*+"^o'^»^^)(it 

and 

Let Kuir) = Kiir) + iVi-°(r) for all r G C+ and let {ft) = (nAr-)- 
We denote by (hI), (H^) and (1^3) the equivalents to (H.l), (H.2) 
and (H.3) respectively, where r G 0~^, and (r^) and E are replaced by 
(ft) and E. 

Clearly, < Kjj, and the following hypothesis is needed to show 
that the boundary condition ([9]) holds for any continuous function / 
satisfying Kl < f < Ku m 0+. 

(H.4) For any r G 0+, 

(39) hm E'^e-^*+"/o ^='^^ir^(r,)x ,c...)^^, = 



neN 
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whenever F^[tI^'^'^'^ = oo) > 0, and for any stopping time t^^'^'^^ 
(40) {e-^^"^"^°^"^^'^^^c/(r.Jx^,(c..)<^J^ 

is uniformly integrable, where r„ = n A rjf •'■•''^ Moreover, Kl E V{A) 
and Ku e V{A), where V{A) = W e C^{0++) HE: Aip e E}, and 
Kl{0) = Ku{0) = 1. 

Note that if (H.4) holds, then it holds simultaneously for both pro- 
cesses (rt) and (f^). 

Assume additionally 

(H.5) For any r G C++, one has A^Kiir) = 0. 

By (H.5), Kl is a subsolution to (!32l) . It is easy to see that under 
assumptions of Proposition HI satisfies (!2T1) : it is enough to take 
a„ = in the proof. Thus is a supersolution to ( |32l) . Hence, by 

(iTs), 

A^Ku + F^Ku) = A^iV^-" + Fm{KL + N'"') 
< A^iV^-" + FmiN^"") < 

and Kjj is also a supersolution. 

Since Kl{0) = Ku{0) = 1, then from the fact that Kl < K < Ku 
(see Theorem H] below) we have a condition A'(O) = 1, which with 
help of fl39l) and fHOl) implies ([9]). Furthermore, the value function 
^{■,v) e C2(0++) n C(C) for any v > 0. The proof of the following 
result is analogous to that of Theorem [2] and is left to the reader. 

Theorem 4. Assume that (H.l) - (H.5) are fulfilled. Then there is 
a solution K to with condition Moreover, K^ir) < K{r) < 
Ku{r), r G . Finally, for any sequence {Xm} C g{A-y) satisfying 
fl28|) for any m > 0, one has 



K{r) = lim lim Ki;'{r), r eO^, 

m^oo n— »oo 

where {K^^} is a non- decreasing sequence of both m and n, defined as 
follows 

K = Kl, 

i^r+i = (An. - A,)-\F^{K^) + X^K^). 



9. Vasicek model 
Let us recall that in the so-called Vasicek model [rt) is given by 
(41) drt = {a- brt)dt + adWt, 
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with a,b,a > 0. Let 

(42) E = {ifeC{R): lim |v;(r)|e-tl"l = 0} 

r|— *oo 

and 

\\ip\\E = sup |v9(r)|e~^l''l. 

Theorem 5. The assumptions of Theorem\^ are satisfied, whenever 

(43) 7 > max{7i,72}, 
where 

aa oP'o^ , aa Sa'^a^ b + 1 

b (1 - a)o2 6 2vl - ab^ b 

Proof Notice that for any stopping time T„, 



< \\m\\pe^f+°'^'>^'^Po<s<t\rs\ 



and, by Fernique's theorem, the r.h.s. is integrable for any fixed t > 0. 
We similarly obtain 



y?(r,)e"^o '-"'^"c^s 







Therefore (H.l) is satisfied. 

It is easy to check that {E, \\ ■ \\e) satisfies (H.2). Assume that (r^) 
is given by (HTi) and that (PJ is given by ([23]) • In Appendix A it is 
shown that [Pt) is a Co-semigroup on E, and hence hypothesis (H.3) 
is satisfied. Therefore we have to show (H.4). We split a verification 
of (H.4) into several steps. 

Step 1. First we show that N{r) < 00 for any r G M. From f HTl) we 
obtain 

(44) rt = re-"' + f{l - e-"') + aXu 
where 

(45) Xt= [ e-^(*-^)rfiy, 

Jo 

and its distribution does not depend on r. In what follows we denote 
by C{C,) the law (distribution) of a random variable ^. Note that 

(46) £{X,)=Af{0,i{l-e-"'')). 



18 D. SYNOWIEC 

Therefore, we have 



poo ^ 

N{r) = EM e-T^*+T^ -^'^'^dt 
Jo 

fca 



and by Fubini's theorem 



(47) Yt:= [ Xsds= [ [ e-''^'-''^ dsdW^ = ]- [ (1 -e-''(*-"))rfVr„ 

Jo Jo Ju b Jq 

which imphes that 

(48) C{Y,) = AT (0, ^(t - A + |e-^* - ie'^^*)) . 
Thus 

N{r') < 6(1-°)'' ' / e 6 2(1-")^''^ ^ 26^6^ 26'- ^(^^ 



,2_2 



e(T^i''i / e 1-"^ 2(1-")''^^ c/t < oo, 



by (143!) . Analogously we can show that by (H3|) . condition (!20|) holds. 
Step 2. Here we show fl25|) . We have just shown that 



g (l-?ci)6 I''"! 



(49) N{r) < 

where 

1 / aa a^o"^ 
^ " V ~ ~ 2(1 - a)b^ 

is positive by (H3|l . Then to prove (125!) it is enough to show that 

lim E''e"'^*+°-^o ^'='^^+1 = o. 
Prom Holder's inequality 

>oo t^oo \ J \ J 

and we easily compute that 

TEi"E^e-T^*+^^o'-»'^^ < lim eir^l"!""* _ ^ 
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Note that given ^ with distribution J\f{m, s^), it is easy to show that 

(50) Ee'l^l <e^(l + e"H). 

Therefore, the expression in the second bracket above is dominated by 
e^ ^1 + e^^^j, which is finite for every r G M. Thus fl2^ holds. 

Step 3. Here we show that the family in fl2B]) is uniformly integrable. 
By the de la Vallee Poussin theorem (see e.g. [9], p. 241), it is enough 
to show that 

(51) supE" fe-^^"+^fo"^'^^'N^-"{rrjy < oo, Vr G C», 



for some (3 < 1. Here we take (3 = a/1 — a. 
By (HI]) we obtain 



p 



where 



and Xt is defined by ( l45i) . Let g{x) = vT+~x^ and h{x) = j vT+~a?. 
Then 

By Ito's formula 



where 



and 



= - 

2 

Note that |5''(a;)| < 1 and l^f'^^^)! < 2. Therefore by the Novikov 
condition Mt = e** is a martingale, and Rt < + |(^)^)t. By (|i3D 
there is a k > (^)^ such that 

b'j — aa — baa aa 1 / acr\ ^ 

> T77 + 7^ T77 + 



6/3 bp 2 \ bp 
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Then 



neN neN t<n 

and it is enough to show that 

sup E sup Mte""* < oo. 

neN t<n 

We have 

n— 1 n— 1 

E sup Mte"'"* < E sup Mte^''* < V e-'^-'E sup Mt 

n— 1 n— 1 

< Ve-'=^(1 +E( sup Mtf) < y e-^^(l + 4EM2 ), 

where the last estimate holds due to Doob's inequality. Since Mt < 
e^bfji where Mt is a martingale of the same form as Mf, but with 
constant instead of then 

n-l 

supEsupMiC"''* < sup Ve-^^(1 + 4e^^^'^^+^^) < oo. 

nGN t<n neN 

Step 4. Here we show that A^^^" G C^iM) n By Proposition H 

j^i-a ^ c'^{^^y To show that iV^"" e E we have to prove that 

lim Ari-"(r)e-tl"l = 0. 

|r|^+cxD 

It is easy to see that 

lim A^^-"(r)e-?l''l = lim N{r)e~^^^''^ = 0. 

r— >— oo r— »— oo 

The condition 

lim Ar(r)e"(i^''"' = 

r— >+oo 

amounts to 

POO 

lim / e-'''-'''~'dt = 0, k>0, 

which clearly holds. 

Step 5. Finally, we need to show AN^'"" G E. By the definition of 
A (see dM])) and the previous step of the proof, we know that AN^'"' G 
C(M). Thus we need to verify the condition 

lim \AN^-''{r)\e'T\^\ = 0. 

|r|— >oo 
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By ( 1211) we have 

I- a (N'{rY 



Since 

/■oo 



where is, by Step 1, a strictly positive integrable function, then N is 
positive and increasing. Furthermore, 

iV'(r) = r -^e'TT^^^'-''~''Uit)dt < -^—N{r). 
Jo or (1 - a)b 

Hence, 

hm WAri-°(r)|e-f 1^1 < hm Ari-"(r)e-fl (^7 + + — i^!^-— ^ 

IrHoo' ^ ^' - IrHoo V 2(1 - a)62y 

and, since N^~°' G -E, the hmit above is equal to zero. □ 

Note that the condition 7 > 71 assures the finiteness of N{r) for any 
r G M and that assumption (120!) holds, and the condition 7 > 72 is 
needed for uniform integrability of the family in (|26l) . 

Let 6 > w?""? and let 

b{l—a) 

E = Es = We C([0, 00)) : lim \^{r)\e-^^' = 0} 

r— >oo 

be equipped with the norm 



Me= sup |<^(r)|e- 

re[0,oo) 



-5r 



Then we have the following result. 

Theorem 6. The assumptions of Theore'm\^ are fulfilled in the Vasicek 
model (1411) . whenever fl43l) holds. 

Proof Verification of (H.l), (H.2) and (H.3) is left to the reader, as 
it is similar to verification of (H.l), (H.2) and (H.3). Here we verify 
only (H.4) and (H.5). To show (H.5) define a sequence of functions 
{K1}, such that 

' A,KUr) = 0, rG(0,n), 
K2{0) = Kl{n) = 1. 



Then, by 
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where Tq^ = Tq A and = inf {t > : = n}. Furthermore, for 
any test function ip G C^((0,n)), 



oo 



which imphes that 



ip{r)A^Kl{r)dr = 0, 



/"OO 

hm / fs:2(r)AXr)rfr = 0. 

n^oo Jq 



Under the following conditions, 

(i) lim ro„ = Tq, Vr>0,VcjGri, 

(ii) P"(ro" < oo) = 1, Vr > 0, 
(iii) sup sup \K2{r)\ < oo, Vj > 0, 

r<j nGN 

which we will verify below, we have limn^oo K2{r) = Kiir) and the 
convergence is almost uniform. Thus, 

KLir)A;if{r)dr = 0, 

and it holds for any ip G C^((0, oo)). By Lemma [H A^Kl^t) = 0. 

Since any Ornstein-Uhlenbeck process is recurrent, then (ii) holds. 
Condition (i) is implied by the continuity of trajectories. To show [iii), 
note that due to Step 3 of the proof of Theorem [5] the sequence of ran- 
dom variables in the second expression below is uniformly integrable, 
which justifies the first equality, and the constant d < oo does not 
depend on r. Thus, 



sup sup I ^^(r) I = sup sup lim e' 

r<j ngN r<j ngN m^oo 



-7(To,„Am)+a Jo r^ds 



< sup sup et*^ sup Ee"^Pt<m(-7t+T*+°'^^0 

r<j nGN m>0 

< dsnpeb^ = de'b^ < oo, 

where Yf is given by fH7|) . 

We proceed to show that (H.4) holds. Since condition (ii) above 
holds, then we do not have to verify (!39|) . 

Note that Ku < Kl + N^~°'. Therefore, by Theorem [5l the sequence 
in fHOl) is uniformly integrable whenever uniformly integrable is the 
sequence 

I 'j neN 
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By the strong Markov property it is equivalent to the uniform integra- 
bihty of 

I '- -'J nSN 

which is fulfilled whenever 

This holds, since Tq A n —>■ a.s n —>■ oo and 

-7(ro-An)+a/;o^"lr,|ds 



is uniformly integrable (see Step 3 of the proof of Theorem [S]). 

Here we will show that G T>{A). Since A^K^ = then G 
C^((0, oo)) and it is enough to show that G E. By the similar 
argumentation to that in verification of {in) in the previous step of the 
proof, we have 

lim \KL{r)\e-^'' = lim lim e-^^^5^"')+» fo^'^"^ ^^^s^-Sr 

< lim ef''-'^'^supEe""P*<-(-^*+'i?*+"''^*) 

< d lim e^"-^" = 0. 

r— >oo 

Now we will show that G V{A), which will imply that Ku G V{A). 
Since, by condition N satisfies 

(52) QN{r) + ^f^N{r) = -1, 

I — a 

then N^e ^^((q, oo)), and consequently iV^"" G C2((0,oo)). Further- 
more, N^^" G -E, since 

lim iV^'"(r)e-^" < lim Ari-°(r)e-'^'^ < p"-^ lim e^""^" = 0. 

r— >oo r— >oo r— >oo 

Analogously, iV^~" G -E^^ for any 6i > a/b, and consequently N G -E^j 
for any 62 > ^p^. 

In order to prove that AN'^~" G E, note that by (1321) . we have 

AN'-^ir) = iV-"(r) f 7 - ^ - ^^il^ f 5:^!: ' ' 
^ ^ ^ M N{r) 2 \^iV(r 

We need the following result. 

Lemmas. Let f G C([0, oo))nCi((0, 00)) and f G ^51. Then f G ^52 
/or ani/ 6"^ > 6^ . 
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Proof Since for any x > 0, one has /(x) = /(O) + f'{y)dy, then 

|/(a;)|e-^'-< |/(0)|e-^'^' + e-(^'-^^)^' f \f\y)\e-''ye-''^'^~y)dy 

Jo 

where M = sup^>o \f'{x)\e~^^'^'. Since /' G Egi, then M is finite. □ 

Going back to the proof of Theorem note that we can rewrite 
as follows 



N 



which implies that the l.h.s. belongs to Es^-, and by the lemma above, 
icT^iV' + (a - hr)N G Es^ for any ^3 > 82. Since (a - hr)N G E^^ C 
then A^' G -E^g. Hence, for any 5i > a/b and 6 = 61 + 26s, "we get 

lim \A^N^~''{r)\e-^' < lim iVi-°(r)e-^i" (7 + ) 

r— >oo 1 — >oo y N(^t'^ J 

+ lim iV^-°(r)e-^^" "^^r"^'^' (iV^(r)e-'^^'-)'- 

It is easy to verify that N is increasing, which implies that N{r) > 
for any r > 0. Thus, the limit above is equal to zero. □ 

10. Invariant interval model 

Here we assume that the short-rate dynamics is given by ([T]), (9 = 
(a, b), where —00 < a < b < •y /a and E = UC{{a, b)) is equipped with 
the supremum norm. 

The sufficient condition for interval invariance is (see [1]) 

s(a^) = —00 and s{b^) = 00, 

where 



s[x) = I e 

w 



for a fixed w G (a, 6). 

It is easy to show that the conditions above holds in the model 

(53) drt = /t(^^ - rt)dt + a{rt - a){b - rt)dWt 

with K, cr > 0. 

Theorem 7. The assumptions of Theorem\E hold in the invariant in- 
terval model (l53l) . 
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Proof Notice that for any stopping time T„ and any fixed t > 0, 

and similarly 



at{\a\V\b\) 







< < oo, 



which means that (H.l) is satisfied. One may easily check that the 
space {E, \\ ■ \\e) satisfies (H.2). Assume that (Pt) is given by fl23|) . In 
Appendix B it is shown that [Pt) is a Co-semigroup on E, and hence 
hypothesis (H.3) is satisfied. Thus we have to verify (H.4). 
Given 6 < 7/a, we have 

POO -I 

N{r) < / eT^(-^+"'')* = 

Jo -f-ab 

and 

(1 \ l—a 

— % I = 0. 
7 — aoy 

Thus N < 00 and (|25|) holds. In the same manner we can see that fl20l) 
holds. 

Recall that flHTl) implies uniform integrability of the family in 
Let (3 = 1 — 0. Then fIFIl) holds, since we have 

supE'"e"i^^""^T^-^o A^(r^ ) < sup e~^^^" = . 

neN " „gN 7 - tto 7 - a6 

By Proposition m one has A^^"" G ^^((a, 6)). Note that A^ is 
bounded, i.e. 

1 — d , l — a 

< < N{r) < < 00. 

7 — aa 'J — ab 

Since A^ is also increasing and continuous, then there exist finite limits 
N{a+) and N{b-). Thus N^-° e UC{{a,b)). By 1^, we have 

AN^-"(r) = N^-^i-^ l-« a{l-a){a{r-a){b-r)N'{r)) 



' ^ N{r) 2N\r) 
Hence, AA^^-" G C((a,6)). Since A^'(r) > for all r G (a, 6), and 

iV(^^) - A^(a+) = / ' N'{r)dr= [ ' (r - a)Ar'(r)^^rfr 

is finite, then necessarily limr_,(i+(r — a)N'{r) = 0. Analogously we 
get limr ^i,-{b — r)N'{r) = 0. Thus there exist limits \imr^a+ AN^~°'{r) 
and lim^^b- AN^-'^ir), which implies that AN'^-"' G f/C((a,6)). □ 
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11. Models with infinite value function 

We will show here that if (r^) is either a Brownian motion or a 
geometric Brownian motion, then the value function in Problem A is 
infinite. 

Let us observe first that we may assume that optimal consumption 
is of the proportional form Ct = CtVt, where 



Ct 



Ct/Vt, t<TA, 
0, t > TA, 



for ta given by ([2]) and q is well defined. Also in this case the HJB 
equation and the optimal consumption C have the form ([6]) and (jHj) 
respectively. Moreover, 

dVt = in - Ct)Vtdt, 

and consequently 

Vt = ve-^oi-^-^^)^' > 0, yv>o,yt<TA, 

which implies that 

Tyi = inf <! t > : / Cgds = oo} . 







Thus from now on, we assume that our consumption is of the propor- 
tional form and 

POO 

(54) JA{c]r,v):=v''W I e-^'c^e" ^o(^'-^^)'i'dt 



with Q = for every t > ta- 

Lemma 4. Assume rt = r = const. Then: 

i) If'y—ar < 0, then there is a consumption rate C such that Ja{C] r, v) - 

oo for all V > 0. 

a) If •y — ar > 0, then 

(55) VI-"/ l-« 

Vt = e^ ' V = el-" f . 

Proof of i) Whenever 7 — ar < 0, then fl54|) gives us the claim with 
Q < ar - 7. □ 

Proof of ii) Since now /i(r) = cr(r) = 0, we have Ct = K^/^"~^^Vt and 

a 

[ar — 7)K + (1 — a)K"-^ = 
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instead of (E]). If 7 — ar > 0, then 

K -- 



7 — ar 
1 — a 



□ 



Remark 6. Recall that if > for every t > 0, then Problem B 
amounts to Problem A. Since condition 7 — ar < implies r > 0, thus 
the first claim in Lemma H] holds also for Problem B. The second claim 
is true for Problem B, whenever r > 0. Otherwise ^^(r, f) = with 
TB = 0. 

Now we formulate necessary and sufficient conditions for finiteness 
of value function ^a- Set 5 = C x (0, 00). 

Lemma 5. i) If^Aif^v) is finite for all {r,v) G S, then 

POO 

(56) Vr e C Vc> e-^*+°^o(-»-^)'^^(^t < 00. 

Jo 

a) If the performance functional is given by fl5^ and 

POO 

(57) 3S>03pe (1, ^) Vr e C EM e-h-s)'it+aq J^rsds^^ ^ ^ 

Jo 

holds with q = p/{p — 1), then ^^(r, v) is finite for all (r, v) G S. 

Proof of i) Taking q = c constant gives us the claim. □ 
Proof of ii) Set 5 > 0. From fl5^ we have 

POO 

Jo 

and from Holder's inequality JA(c;r, t>) is dominated by 

v'^W (^j^ Q-('y-i)it+'^iIo^sds^^^ " ^j^ e-^P*ct^e-''P^o^''i^dt^ " . 

From Lemma m with r = 0, the expression in the second bracket above 
is finite for every S > and p > 1 such that ap < 1. Thus ( 1571) gives 
us the claim. □ 

Proposition 5. // (r^) is a drifted Brownian motion 

rt = r + fit + aWt, 
or (rt) is a geometric Brownian motion 

then ( 1561) does not hold for any c > and consequently the value func- 
tion $A for Problem A is infinite. 
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Proof Notice that C{J^Wsds) =Af{0,t^/3), which imphes 
Thus if (rj) is a drifted Brownian motion, then 



oo 



Jo Jo 

oo 



for all c > 0. Hence, ^A^r, v) = oo. 

Notice that > y for all ?/ G M. Thus if (r^) is a geometric Brownian 
motion, then we have 

/•oo /"OO ^ 2 

W e-^'+''^oirs-c)ds^^^ ^-i^+aOt^^arJ^e^'^-^^^^+^^^ds^^ 

Jo Jo 

"CO 

> / Q-{l+<^c)t-^^ar J^{{ti-^a^)s+aWs)ds^^ 
oo 

g-(7+«c)t+iar(/.-if72)i2 + ia2r2<72t3^^ ^ ^ 









for all c > 0. Hence, $^(r, f) = cxd. Moreover ^B{f,v) = oo, since in 
this case > for every t > 0. □ 

12. Numerical results 

Here we present a numerical solution for a Vasicek model with pa- 
rameters a = 0.03, b = 0.5 and cr = 0.02. We take a = 0.5 and 
7 = 1.5304, which satisfies the condition ( l43l) . Since ■y > (see (l29l)). 
we take = am + 10~^. 

Recall that the value function is given by $(r, v) = K{r)v°', and K{r) 
is as in Theorem [2l Therefore we have to approximate the function K 
by for some large m and n. Since Kl^{r) is given by recurrent 
formula 

/>00 POO ptmax rVmax 

^0 ^-OO J train J Vmin 

with a complicated function S^_^ such that lim^io 'S'^]^(t, r, r) = oo, 
then we use trapezoidal quadrature. We take At = 0.001 and Ay = 
0.0002 to get the result with a small error. In fact this makes the 
calculations very time-consuming. Thus we take m = 65 and n = 25 
and we have the result as in Figured] for r e (0, 0.15). The result over 
the range (—6, 8) is given only for due to very long calculations of 
for i > 2. 
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Figure 1. (left) The dashed hne is a supersolution 
A^^~"(r), and the sohd hnes are Kf^ir) for i = l,...,n. 
(right) The dashed hne is a supersolution N^~°'{r), and the 
solid line is K'^{r). 



Next we compute trajectories of the wealth (Vt), the optimal con- 
sumption {Ct) and the relative consumption (q) = (Ct/Vt) for a given 
realization of the interest rate (r^). Clearly we take KJ^ instead of K. 
The results for initial r = 0.05 and f = 3 are given in Figure [2l 




Figure 2. Trajectories of processes r(t,a;), y(t,a;), C(t,a;) 
and c(t, u)) for the same a; G ri, r = 0.05 and v = 2>. 
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Appendix A - proof of Co-semigroup property of (Pt) in 

CASE OF VASICEK MODEL 
For any : R i-^ M define 

\\(p\\ = sup |y9(r)|e~'6 

Note that H^^H < oo, and H^^H = W^pWe for E E, where E is given 
by (l42l) . We assume that (rj) and (Pt) are given by (HB and ( |23l) 
respectively. 

In the subsequent steps of the proof we need the following result. 
Lemma 6. For any E E and any t > 0, 

2 2 

( a (T I aa \j. , , 

\\PM\ < 2e^~^^~>^\\ip\\. 

Proof Notice that we do not assume that Pt^p € E. This will be shown 
later. Let Xt and Yt be given by ( l45|) and f j47l) respectively. We have 



rGK rglf 



|Pt(^|| = sup |Pt(^(r)|e-^l'^l < supEn¥^(ri)|e"^o-^'^--f 

< ||<^||supE"e°^o"='^'+^(l'^*l-l"l) 

< M supet(i-^"*)(^-l'-l)+^*Ee°'^(^l^'l+^*) 

2 2 

< 2e b e ||(p||. □ 



Step 1. Denote by Eup the space of all functions (p G E, which are 
Lipschitz continuous. Here we show that Pt<p> G C(]R) for any (p> G Eup. 
Define a sequence {ipk} of continuous functions 

r 1, x G [-/c,/c], 

[ 0, X e {-oo, -k-l]U[k + 1, oo). 

Then 

\Ptip{x) - PMy)\ < IO1I + IO2I + IO3I, 
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where 



O2 = E^vp(ri)e"/o ^^"^^ (^1 - [I'-^ds^) ' 
Now we show that limy^x \0i\ = 0. To this end write 



ht 



Tsds and Ct = {n, ht) 



and define a function (pkiC) as 

0,(r, /i) = (^(r)e"VfcW, 

which is Lipschitz continuous with constant L, since both 0(r) and 
e^^ipkih) are Lipschitz continuous. Denote by (f the value of Q with 
initial condition (q = (x, 0)^. We have 



ioii = \E[M(n - Mcm < mct - ah < l^/ewq - awi 

where || • II2 is the Euclidean norm. 
Since 



dCt = KCt)dt + aiCt)dWt :-- 



a — brt 



dt + 



o 




dW,. 



with and a Lipschitz continuous, then from the mean-square conti- 
nuity of C (see [9]) we have 



lim|Oi| < limL^E||Cf-Clli = 

for all G N. 

Since we consider y close to x, it is now sufficient to show that IO2I 
converges to 0, as A; — > cxo, uniformly in {x : < 5} for any 5 > 0. 
We obtain 

IO2I < ||<^||E^etl^'l+"''*|l-^fc(/ii)|, 
and from the Schwarz inequality 

IO2I < ||<^||VE^e2fl'^*l+2«'^VP'^(l^il > k). 
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By ( 1501) and Chebyshev's inequality, 

F%\h,\ >k)< ^ < ^ 



< ^ < ^ 0, 

- k - k 



as k —>■ oo. In a similar way we show that 



sup E^e2^'''*l+2"'*' < sup VE^e^tl'-*! Vi^e^^ < oo 

\x\<S \x\<6 

for every t > 0. Thus linifc^oo IO2I =0 and the convergence is uniform 
in {a; : |x| < 6}. 
Thus we have 

lim \Ptipix) - Ptifiiy)] < lim limdOsI + IO3I) = 0. 

y — k — ^00 y — ^x 

Hence, Pf^? is continuous for all t > and ip G Eup. 

Step 2. We show that Pt^p G C(]R) for any ip ^ E. Let us fix a 
ip E E. As Eiip is dense in E, there exists an approximating sequence 
{iPn} such that ipn G Elip and in 

Set e > 0. We have 

\Ptip{x) - Ptip{y)\ 

< \Pt{^ - + \Pt{^ - ^n){y)\ + \PtMx) - Ptp^n{y)\ 

< WPtiip - <^„)||etl^l + \\Pt{ip - y^„)||ef 1^1 + |Pt¥^„(x) - Pt</^„(y)| 
and from Lemma [6] 

Ve: > 3no Vn > no ~ V^n) II < ^• 

Furthermore, from Step 1, Ptipn G C'(IR), i-e. 

Va:GM35>0VyGM |x - y| < 5 ^ |Pt¥P„(x) - Pty^„(y)| <£ 
and therefore 

\Ptip{x) - Ptip{y)\ < £(e^l"l + e^(l"l+'') + 1). 

Step 3. Here we show that Pt : E \^ E. For any ip E E write 
/(V.)= lim |P,y,(r)|e-fH. 

|r|^oo 

We need to show that l{ip) = 0. From (jUj) and fHTj) we have 
/(y?) < lim E''\ip{rt)\e"-fo-^ds-f\r\ 

\r\^oo 

= hm En</^(ri)|eT(i-'='")+T(*-i(i-^"*))+"'^^*-tl^l 

|r|— »oo 
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and from the Schwarz inequality 

l{ip) < lim eif(i-e-")-fl'-leif(*-|(i-e-"))Vfe^^E-<^2(^^). 

Hence 

|r|— >oo 

where 

git) :=e^(*-^(i-<^""))v/fe^. 

Clearly g{t) < oc for any fixed t > 0, by (jH]) and (!50|) . 

Set £ > 0. Since ip & E, then there exists a 5 > such that 

|¥,(r,)| <eefl^*l 

in a set {u : |rf| > 5} and therefore 

where || ■ is the supremum norm over < 6}. Clearly \\(p\\s < oo 
for every (f ^ E. From fl44l) . 

I'iif) <e^^?^(t)e^(^-^"")Ee'f"l^*l lim e^f 

-bt\ 



+ lim e^fW---)-M) 

|r|— >oo 



and 



by die]) and ([50]). Hence, Pi(/? G 

Step 4. Clearly Pq = I and PfPs = Pt+s holds since (r^) is a Markov 
process. We need to show strong continuity of (Pj), i.e 

(58) lim \\Ptip - ifiW =0, Vy? G E. 

Taking into account Lemma [6] and the Banach-Steinhaus theorem, 
it is enough to show ( |58ll for ip G Co(M). For such a we have 

\\Pt^ - ifW = sup \E'if{n)e''^orsds _ y,(^)|e-f I*-! < + O2 + O3, 
where 

01 = sup |E"(e"^o-='^- - l)^(r)|e-f I*"!, 

reIR 

02 = sup|EXrt)-</^(r)|e-^l^l, 

03 = sup |E'^(e"^o-^'i- _ l){ip{rt) - (^(r))|e-^l'^l. 
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Since 99 G Co(M), then there exists a. 6 > such that suppcp C (—5, S) 
and 

hmOi < llojIUhm sup le-''^'''*^ - lle"'^'''! 

no no 

where 

/(M)=^(l-e-) + ^(.-i(l-e-) 

^ 262 y 2b^ b 2b 

Since hmt^o/(^)^) — uniformly in {|r| < 6}, we easily verify that 
hmt^o Oi = 0. 

Set e > 0. Recall, that every continuous function on a compact set 
is uniformly continuous. Thus there exists a p > such that 

O2 <£SupP(|rt-r| <p)e~fl^l+sup / \(p{rt) - (p{r)\e-'^\''\dF 

rSM reM J {\rt-r\>p} 

< £ + 2||(^||ooSupP(|rt -r| > pje"^'*"', 

where || • ||oo is the supremum norm. Hence 

lim02 < e + 2\\(p\\r^ limsupP(|r+ — r| > p)e~^'''' 

no no r€W 

= £ + 2||(^||oo limsup e-f 1^1(1 + A^o,i(n) - ^o,i('^2)) 
where iVo,i(-) is a normal distribution function of A/'(0, 1) and 

The supremum is attained at r = ±00 or r = r(t) < cxo, but with a 
possible infinite limit, i.e. lim^j^o 1^(^)1 < oo- this cases we obtain 

limsupe-?H(i + No,i{n) - 7Vo,i(r2)) = 0. 

Hence, taking e — > 0, lim^j^o O2 = 0. 
Finally, from the Schwartz inequality 

limOa < 2||(^||oolimsupA/e-2fl'-lE'-(e%*''»<^^ - 1)2, 

no no rSR 

where we can easily derive an analytic formula of E''(e"-^o ~ 1)^- 
Then we take into consideration all the possible realization of supre- 
mum f, as above, and we get lim^j^o O3 — 0. 
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Appendix B - proof of Co-semigroup property of (Pt) in 

CASE OF INVARIANT INTERVAL MODEL 

In order to prove that Pt'- E ^ E we need to show that Pfip G 
UC{{a, b)) and this may be done in a similar way to the proof of con- 
tinuity of (Pt) in Appendix A. Since Pq = I and PtPs = Pt+s clearly 
hold, so in order to prove Co-semigroup property of (Pt) we need to 
show that fl58l) holds for E = UC{{a, b)) equipped with the supremum 
norm 

\\(p\\ = sup \^{r)\. 

r€{a,b) 

Let (f & E, then 

^\\ = sup |EV(ri)e°/o '^^'^^ _ < + O2 + O3, 

re{a,b) 



01 = sup |E'^(e"^o -^'^^ - l)ip{r)\, 

r&{a,b) 

02 = sup IE"" Lp{rt) - v?(r)|, 

re{a,fe) 

03= sup |E^(e"i'o^^'^^-l)(y.(rt)-</.(r))|. 
Since < 00 for every (f & E, then 



limOi < \\ip 
tio 

< y 



and 

limOg <2y\\ lim(max||e""* - 1|, le""* - 1|}) = 0. 
iio tio 



where 



limEHe^^o'-^'^*- 1| 

m 



lim(max||e"'^* - 1|, le"''* - 111) = 
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Let Eiip be the space of all Lipschitz continuous functions (p E E. 
Let (f e Eiip and let L be the Lipschitz constant of (p. Then we have 

\\Pt(p - </^|| = sup \W(p{rt) - (p{r)\ 

re{a,b) 

ft rt 

< L sup W\rt - r| = L sup E'^ 

re{a,b) re{a,b) 



< L sup 

re{a,b) 



/ ii{rs)ds+ / a{rs)dWs 
Jo Jo 




< L sup 

re{a,b) 



<Lj2t^ sup |/x(r)|2 + 2t sup \a{r)\'^. 

r&{a,b) r^{a,b) 



Hence, lim^j^o \\Ptf ~ = for every ip e E^p. Since Enp is dense in 
E, we conclude by the Banach-Steinhaus theorem. 
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